Data In Connectors

Bring data into Visier directly from your source system.

Overview

Visier's data connectors simplify the data loading process. Using an automated workflow, data connectors connect and extract the raw data directly from your source systems, subsequently transforming and processing it within the Visier platform.

Data connectors are an alternative to generating flat files and transferring them to Visier via SFTP. To learn more about the different ways to bring your data into Visier, see Data In.

Tip:  

Supported connectors and requirements

Note: You can retrieve the list of existing data connectors in your solution with Visier's public APIs. For more information, see Data and Job Handling API.

Visier seamlessly connects to multiple data sources. Click the source name to learn more about the requirements to get started.

Note: If you're interested in a connector that is in beta, please contact your Partner Success Manager (PSM). If you are unsure who your PSM is, please create a technical support case through the Visier Service Portal.

Data in connector workflow

Note: Depending on your data source, you may not need to complete steps 7-9 in the workflow below. If your data is stored in a generic data warehouse or database, steps 7-9 are applicable to you.

  1. Create a service account in your source system that enables Visier to connect your data to our solution. For more information, see Set up a service account.
  2. Create connector credentials to authenticate Visier with your source system. For more information, see Provide connector credentials in Visier.
  3. Create a connector to enable data extraction from your source system. For more information, see Create a connector.
  4. Determine what data you want to extract from your source system by modifying the connector's imported tables, attributes and filters, and other settings. For more information, see Data In Connectors.
  5. Run an extraction job to retrieve data from the source system. For more information, see Run a Data Connector Extraction Job.
  6. Create a data category for the data you are uploading. A data category represents a dataset loaded into Visier that runs on a unique data load frequency. For more information, see Data Categories.
  7. Create and configure mappings to specify how the data in your source is loaded into Visier. Mappings connect the source files' columns to the properties in Visier's analytic objects. For more information, see Add a Mapping.
  8. Run a job to generate a data version. Jobs define the tasks needed to load your data into Visier, for more information, see Run a Job. A data version is a instance of uploaded data with a unique release number. For more information, see Data Versions.
  9. Preview the data in the solution to confirm that the data is being shown correctly. For more information, see Preview a Project.

Data connector architecture

Data connectors utilize a service account in the source system to authenticate an HTTPS connection to read the data from the source system. The data access and security permissions granted to the service account are controlled by the end user in the source system.

Depending on the source system, the required permissions may be different. For source requirements, click the source name in Supported connectors and requirements.

Tip: After service account credentials have been connected to Visier, the credentials are placed in an encrypted secret store that doesn't allow individuals to read the contents. If you need to update an existing credential, you must input each field again because the fields are protected from view.

Visier's data connectors retrieve data in the following ways:

  • REST. Visier utilizes your source system's API to securely retrieve data over HTTPS and generate a stream of data.
  • Java Database Connectivity (JDBC). Visier uses a standardized API to connect directly to your source system's database to securely retrieve data and generate a stream of data.
  • Simple Object Access Protocol (SOAP): Visier uses this XML-based protocol to retrieve information from your source system.
  • GraphQL API: Visier uses this API to retrieve the exact data required from your source system.
  • Other. Visier may use alternative retrieval methods in special cases. For more information, contact Visier Customer Support.

Visier reads the data stream and generates a set of records that are stored within Visier's data store. These records are then loaded into the solution via the traditional data flow.

Retrieval Method

Data Source

REST API
  • Dayforce
  • iCIMS
  • Oracle Fusion
  • Qualtrics
  • SAP SuccessFactors
  • UKG Pro

JDBC API
  • Amazon Redshift
  • Google BigQuery
  • Greenhouse
  • Microsoft SQL Server
  • Snowflake

SOAP
  • Workday

GraphQL API
  • Medallia

Other
  • Amazon S3

Note:  

  • Please see Visier's Trust Assurance Overview for a detailed diagram of the data flow. If you don't have Visier's Trust Assurance Package, contact Visier Customer Support.

  • For JDBC connectors, we can connect to database objects including tables, views, materialized views, stored procedures, and more. We cannot read parameterized stored procedures.

Methodology

Initially, data connectors retrieve a full history for each subject to generate an initial history of events.

For each subsequent extraction, the connector identifies subjects that have experienced a change and restates a full history for each of these subjects.

A full history is retrieved per subject to accommodate for any corrections made on the subject throughout history. By identifying the subjects that experienced a change, Visier reduces the volume of data retrieved by generating a semi-delta load and allows for self-healing correction workflows in the source system.

It is recommended that you execute daily extraction and data loads to keep load times at a minimum.

In this section